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PR^ACE 

In  previous  Memoranda,  the  problem  was  considered  of 
observing  the  output  of  a  black  box  comprising  a  complex 
differential  system,  determining  the  nature  of  the  system 
and  its  subcircuits,  and  estimating  when  the  box  switches 
from  one  subcircuit  to  another,  and  which  one  is 
operating  at  any  time.  In  all  this  work,  no  account  was 
taken  of  previous  information;  we  examine  here  the  compu¬ 
tational  reduction  that  may  be  achieved  by  using  such 
infomiation.  The  method  used  has  a  built-in  quality- 
control  check  on  its  efficiency. 

Applicability  of  the  mathematical  concepts  discussed 
in  this  Memorandum  would  be  of  particular  interest  to 
control  engineers. 


SUMMARY 


In  two  recent  papers,  we  have  used  a  blend  of  dynamic 
programming,  quasilinearization,  and  differential 
approximation  methods,  which  we  call  segmental  differential 
approximation,  in  order  to  estimate  the  parameters  of  the 
differential  subcircuits  of  a  black  box  and  the  times 
of  switching  from  one  to  another,  using  only  the 
information  provided  by  the  output  function,  either  at 
sample  points  or*  continuously. 

We  discuss  here  the  extension  of  these  results  to 
an  adaptive  procedure,  in  which  the  computations  are 
reduced  as  the  number  of  switchings  that  are  occurring 
becomes  large,  relative  to  the  number  of  subcircuits 
present  in  the  system.  In  the  method  used,  there  is  an 
innate  quality  control  on  the  approximation. 

The  method  may  be  further  refined  for  electrical 
systems  that  are  known  to  be  linear. 
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ADAPTIVE  SEGMENTAL  DIFFERENTIAL  APPROXIMATION 


INT^ODUCTpN 

Suppose  that  it  is  desired  to  observe  the  output 
f(t)  of  a  black  box  comprising  a  differential  system 
with  unknown  parameters.  When  no  switching  occurs,  a 
linear  approximation  describing  the  nature  of  the  system 
may  be  obtained,  using  the  techniques  of  differential 
approximation  [1]  and  quasilinearization  [2],  When 
switching  is  known  to  occur  periodically  from  one 
subcircuit  to  another,  estimates  of  the  times  and  nature 
of  the  switchings,  and  of  the  component  subcircuits  of 
the  black  box,  may  be  obtained  using  segmental 
differential  approximation  [3],  (4],  a  technique  that 
comprises  a  blend  of  differential  approximation,  quasi- 
linearization,  and  dynamic  programming. 

What  the  method  gives,  for  f(t)  observed  in  [0,T], 
is  estimates  t^,  T2, . . . ,  (0  <  <  "^2  ^  -  "^N-l  - 

of  switching  times,  and  differential  approximations  u 
to  f(t)  in  f ^ *^1^+1 )  ^  where  u  satisfies  the  linear 
differential  equation 


(1.1)  +  bik“ll-l  +  ‘’2k“ll-2  ■  0’ 


with  initial  conditions 


(1,2)  Uj(Tj.)  -  Cjj^,  j  -  0,.,,,M  -  1,  k  -  0,.,,,N  -  1, 
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k  k 

and  u  is  the  m— th  derivative  of  u  • 
m 

These  estimates  are  such  that  they  minimize  either 
S.  or  S«,  where 


N-1 

(1.3) 

^  k-0 

and 

N-1 

(1.4) 

S.  -  E 
®  k-0 

tie[Tj^,T^^l) 


lu^(t)  -  f(t)]2dt>. 


Equation  (1.3)  corresponds  to  the  case  in  which  we 
are  given  sample  data  f(t^),  0  <  t^  <  T,  and  equation 

(1.4)  to  that  in  which  we  observe  f(t)  continuously 
in  [0,T]. 

2.  ADAPTIVE  APPROXIMATION 


Suppose  now  that  the  black  box  is  observed  over  a 
period  of  time  [0,RT]  sufficiently  long  that  each 
subcircuit  is  used  in  a  large  number  of  sub intervals.  If 
we  use  our  previous  method,  we  will  obtain  RN  sets  of 
values  of  the  parameter  M-vector  ’  *  ’  ^^Mk^  " 

k  ■  1,...,RN.  If  there  are  actually  P  subcircuits 
e^,...,ep,  then  there  will  be  n(l) ,n(2) , . . . ,n(P)  values 
of  b  associated  with  them  respectively,  where 


(2.1) 


P 

E  n(w)  -  RN, 
w*l 
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and  if  the  approximations  are  good,  the  RN  points  in 
M-space  corresponding  to  the  RN  b's  will  form  P 
clusters,  with  n(w)  points  in  the  w— th  cluster  corre¬ 
sponding  to  the  subcircuit  e  . 

If  we  then  estimate  the  "centers"  of 

these  clusters,  and  a  statistic  of  spread  within  each 

cluster  e  — such  as  average  distance  from  the  center  B  — 
w  — w 

then  future  decisions  as  to  whicn  subcircuit  is  in 
operation  may  be  made  by  minimizing  a  criterion  function 
over  a  finite  set  of  P  values  corresponding  to  the  P 
points  rather  than  over  the  infinity  of  points  in 

^space  in  the  original  method.  In  other  words,  we  may 
use  the  information  about  the  nature  of  the  black  box 
obtainea  earlier  to  reduce  the  problem  to  a  discrimination 
problem. 

The  idea  will  become  clearer  if  we  first  consider 
linear  differential  systems. 

2.1.  Linear  Systems 

Let  us  now  assume  that  the  black  box  is  known  to  be 
a  linear  differential  system,  consisting  of  P  (P  unknown) 
linear  differential  subcircuits  of  orders  less  than  or 
equal  to  M.  Provided  that  N  is  larger  than  the 
maximum  number  of  switchings  per  time— interval  T,  the 
segmental  differential  approximation  method  described  in 


[3]  and  [4]  will  in  fact  give  exact  fits;  i.e.,  the 


■» 

minimum  values  of  or  Sg  obtained  will  be  zero. 

In  this  case,  then,  the  P  clusters  in  ^space 
will  have  zero  radius,  n(w)  values  being  obtained, 

w  -  1,,..,P.  After  this  large  number  RN  of  b's  has 
produced  the  P  points  from  then  on  we  compare  the 

present  output  with  them  to  determine  which  subcircuit  w 
is  operating.  For  example,  in  the  interval  of  time 
[RT, (R  +  1)T),  confining  ourselves  to  the  continuous  data 
case,  we  proceed  as  follows. 

First,  we  perform  some  computations  associated 
with  the  ^  that  we  shall  require  in  all  future  time- 
interval  analysis;  for  each  B  we  obtain  M  independent 
solutions  u'^(t)  of  the  differential  equation  associated 
with  Then,  in  equation  (1.4),  must  be  one  of 

the  u'^(t).  Referring  back  to  [4],  if  +  1)T]  is 

the  minimum  value  of  Sg  (i.e.,  zero),  then  we  have  the 
functional  equation 

(2.2)  Fjj[(R  +  1)T]  -  min  [Fj^^(t)  +  Sg(T,(R  +  1)T)], 

T 

where  RT  <  t  <  (R  +  1)T, 


and 


If  S  0,  this  implies  either  that  M  is  smaller 
than  the  maximum  subcircuit  order,  or  that  N  is  smaller 
than  the  number  of  switchings,  or  both. 
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(2.3)  Sg(T,(R  +  L)T)  =  min  '  [u  (t)  -  f(t)]^dt, 

V'/  ' 

T 

entailing  a  discrete  iinitc  search.  Note  that  if  there 
are  N  switchings  in  [RT,(R  +  1)T),  then 
F^l[  (R  +  1)T]  ^  0,  so  that  equation  (2.2)  is  always 
meaningful.  Since  we  compute  the  iteratively,  if 

r^  is  the  first — and  lowest — r  for  which 
F  [(R  +  )T1  =  0,  we  then  know  that  there  have  been  r^^ 

switc''ings  in  the  time— interval .  If  r^  N,  either 
our  choice  of  N  was  not  large  enough — which  we  have 
hypothesized  not  to  be  the  case — or  what  is  discussed 
below  occurs. 


2.1.1.  Quality  Control.  If  +  1)T]  turns  out 

to  be  nonzero,  this  implies  that  a  subcircuit  has  been  in 

use  during  the  time— in terval  [RT,(R  +  1)T)  that  has  not 

been  used  before.  In  other  words,  our  estimate  P  is  in 

error,  and  there  is  in  fact  a  further  ^  to  be  computed. 

For  this,  we  have  to  return  to  the  original  method. 

Wliat  in  effecL  is  happening  is  that  we  have  a  nice 

built-in  indicat-or  I'.,  in  the  method  that  shows  when  a 

i\ 

subcircuit  is  used  for  the  first  time:  in  this  case  we 
simply  go  hack  to  the  method  of  [3]  and  [4],  so  that  at 
the  very  worst  we  make  the  same  computations  as  in  the 
original  method,  and  usually  are  much  better  off. 


2.2.  Nonlinear  Systems 

If  we  apply  the  same  procedure  to  approximate 
identification  of  nonlinear  systems  with  unknown 
parameters  but  known  parametric  type,  then  the  problem 
is  conceptually  much  as  before. 

If  the  type  of  system  is  unknown,  and  we  use  linear 
differential  approximation,  then  the  cluster  will 

not  have  zero  radius,  and  statistical  methods  of 
estimation  must  be  introduced. 

Such  a  method,  for  example,  would,  roughly  speaking, 
be  as  follows: 

(a)  Identify  and  separate  the  clusters  using  some 
discriminating  procedure. 

(b)  Determine  for  each  cluster  a  point  ^  such 
that  the  maximum  distance  r^  of  any  point  in  the 
cluster  from  B  is  minimized. 

— W 

(c)  Proceed  as  in  the  linear  case,  where  will 

now  not  be  zero. 

(d)  If  Fj^[  (R  +  1)T]  is  larger  than  a  prescribed 
error  criterion  e,  re— estimate  the  B  and/or  P. 

3.  CONCLUSIONS 

We  have  considered  above  an  important  new  method  for 
solving  the  "inverse  problem"  of  identifying  the  nature 
of  black  boxes  from  their  outputs.  When  the  box  is  known 
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to  have  differential  characterizations  of  knovm  parametric 
types,  where  the  values  of  the  parameters  are  unknown,  the 
method  is  exact  and  computationally  cci.nomical. 
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